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ABSTRACT , 

A multitrait-multimethod design provided the basis 

for variable selection and analysis on the nature of cognitive 
impulsivity in natural classroom settings. Observational measures 
ie?e developed for field dependence^independence as well as for low- 
and high conceptual level to determine their ecological validity. 
They were designed to form an inferential hierarchy for each of the 
styles! completing the multitrait-multimethod matrix. Teacher rating 
scales global measures, and behavior check lists were developed. 
ISbjecis we?e six femal^ and six male adult student prison inmates 
(mean age = 31.6, mean grade level = 11). O*'""^^^ ^ 
viewing a 40-minute videotape of students engaged in classroom 
discission and problem solving activities. The reflect ion- impulsi^ 
style construct emerged as an ecologically valid and parsimonious 
descriptor of a component of student behavior. The unusually high 
rank-i?der correlations obtained and the patterns which emerged from 
JSe matrix suggest justification for use, although results in terms 
of c6?relatio?s must be viewed as tenuous in view of the small number 
of subjects involved. (PN) 
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I nt roduct ion 

Children and adults who fail to act with adequate forethought 
and circumspection in the face of uncertainty may demonstrate engaging, 
even enviable, characteristics such as spontaneity, inventiveness or 
courage. But if such behaviour consistently typifie's encounters with 
their environment, these persons may rob themselves, their families and 
the community of the many reciprocal benefits each holds for the other. 
As students, they may not attend well to their school curriculum and 
thereby deny themse 1 ves' opportun i t i es available to their peers; they 
may cause moments of intolerable frustration for parents, teachers and 
other supervising adults who co-pe in ways which only aggravate the 
problem. And for varying periods of their youth and adulthood, they 
may become a financial liability to the community because of the need 
for placements in special and costly settings (e.g. special education 
classes, training school/, etc.). 

Within the lexicon which attempts to label such behaviour, the term 
impulsive looms large. It has been estimated that upwards of 30% of 
the school age population display impulsive characteristics to the extent 
that functional ability is impaired (Margolis et al., 1977). According 
to the Senate report Chi Id at Risk (1980), alarming increases in juvenile 
delinquency partially stem from children not learning how to cope with new 
sources of stress in the family and community^. Their reactions to stress 
are often inappropriate and may be characterized as frequently impulsive. 
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■2. 

The cognitive style^ construct of ref 1 act i on- i mpu l6 i vi ty (Kagan. 
1966) offers the teacher an Intuitively appealing means for describing 
willingness or ability to "stop and think." Operationally, the style / 
is typically measured by the Matching Familiar Figures Test (MFFT) 
which records latency to first choice and accuracy of choMce in a series 
of twelve non-verbal problem-solving tasks. The task involves matching- 
a stimulus drawing to one correct drawing among eight facsimiles. in 
traditional studies of Impulslvity, those subjects who fall above the 
sample. median on errors and below the sample median on latency (fast/ 
inaccurate) are referred to as impulsive. Subjects who fall In the 
opposing quadrants are referred to as reflective (slow/accurate). 

As with many quickly administered, non-verbal, paper-and-penci 1 
tests on individual differences, the MFFT is a highly inferential 
measure. It observes only a narrow band of behaviour yet it is used 
35 a general Izable sample, predi^^ztlve of- a wide spectrum of behaviour 
involving complex cogn i t i ve act I vl ty (see review by Messer, 1976). 
Explanations for Impulsivity imply this wide spectrum and, as well, 
appear to subsume other cognitive style constructs. Lack of self-control 
and inability to delay gratification expands on the behavioural explana- 
tion of Kagan and associates (Mahoney and Thoresen, 197^; Ainslie, 1975; 
Kendall and Wilcox, 1979). Cognitive explanations centre on a deficiency 
in mediated learning experience (Feuerstein, I98O), a response inhibiting 
.control hypothesis (Kendall and Finch, 1976, 1979), a failure to use 
private speech in self-regulation (Me I chenbaum , 1977), and deficiencies 
in social adjustment skills (Splvak, Piatt and Shore, 1976). Common 
threads running through these cognitive explanations Involve Inapprop- 
riate attending and search and scan strategies. Inability to hypothe- 
size the consequence of various courses of action and accepting the first, 
available response which may result from peer influence. Each of these 
imply the inclusion of other cognitive styles within the ref 1 ect i on- i mpuh 
ivity style. They will be specified later. 



^Defined as the stable ways in which persons differ in perception and 
encoding information (Wittrock, 1978), - the degree of 7""^;;^^^,^ 
rather than level of performance (Kogan, 1971) and as executive controls 
on cognitive functioning (Guilford, I98O). 



As powerful and appealing as the impulslvlty label might be for 
the teacher, it will be of little use for prescriptive purposes if 
certain criteria are not met. First, it must be amenable to a defini- 
tion upon which users can agree. And this definition must not be so 
general that it characterizes too broad a band of behaviour, thereby 
characterizing little of value. Second, the now classical operational 
definition of impulsivity from the MFFT (fast/inaccurate) must be 
observed reliably in the sorts of learning which occur in typical class- 
room settings - that is learning which is verbal and cognitively complex. 
At issue here are the requirements of construct validity which includes 
discriminant validity (the first criterion above) and ecological validity 
(the second ) . D i scr i m i nan t va 1 i d i ty ref e rs to the i ndependence of 
traits. The criterion is tKe identification of a method or methods 
which measure a discrete trait to the exclusion of others (Campbell and 
Fiske, 1959). Ecological validity refers to the saliance of behaviours 
predicted and described by the construct in non-contrived settings. 
A criterion is the degree of association between predictive measures and 
observations In educa t i ona 1 1 y- re 1 evant settings (Bracht and Glass, 1968)% 
It was with these concerns in mind that a study was conducted on the 
nature of cognitive impulsivity in natural classroom settings (Campbell and 
Davis, 1981). 

Subjects 

Subjects for the study were six female and six male adult student 
prison inmates. The mean age was 3^6 and mean grade level was 11. Student 
participated in the study voluntarily and' attended classes in their prisons 
over a two month period during which time they were observed and interviewed 
An inmate population was selected because of the high likelihood that 
students would demonstrate impulsive characteristics (Ward and Yeuda 1 1 , 1 980 ; 
Messer, 1976; Yochelson and Samenow, 1976). 

Variables 

A mul t i t ra i t-mul t imethod design (Campbell and Fiske, 1959) provided 
the basis for variable selection and analysis. In order to assess discrim- 
inant validity, three cognitive style measures were selected which, it 
was predicted, would share substantial variance with ref 1 ect i on- i mpul s i v i ty 
and therefo-e be partially subsumed under it. Multiple methods for assessin 



each style were designe^d to form an inferential hierarchy, from low 
inference to high inference measures. 

Regarding discrimlnaot validity, it was predicted that reflectlon- 
impulslvlty would significantly correlate with field dependence- i nde- 
pendence (WItkin, 1977). conceptual level (Hunt, 1971. 1977) and atten- 
tiona-'i focus (Nideffer, 1976). The specific measures used were, respect- 
ively, error-rates on the adult/adolescent MFFT (Kogan, n.d.), the Group 
Embedded Figures Test (Oltman et al., 1977), the Conceptual Level para- 
graph completion test (Hunt et al., 1977) and the "external overload" 
subscale in the Test of Attentlonal and Interpersonal Style (Nideffer, 1977) 

Field dependence-independence is a cognitive style which attempts 
to account for the degree to which a person is able to perceive and 
encode discrete Information from the environment. Persons who tend to 
be field dependent, unlike their Independent counterparts, perceive their 
environment ho 1 I st I ca 1 1 y , do not use Its discrete elements, and thus fail 
to make what may be important discriminations. Because of this failure to 
di.sclngulsh between relevant and irrelevant cues In one's environment, 
the field dependent person's behaviour tends to become "lost" when highly 
salient cues are absent, or tends to be guided by social orientations 
provided by other persons. As might be expected. Impulsive persons tend 
to be field dependent (M^sser, 1976). in the face of uncertainty or 
ambiguity, they Inefficiently scan the environment for cues and may offer 
'a response which shows an absence of reflective thought. It can be 
Inferred that executive control of behaviour through cogn 1 1 1 ve. med I at ion 
is either blocked or Impaired by Immediate and salient external cues. 
In a school setting highly Impulsive and dependent persons might tend to 
be followers, group oriented, non-committal or perhaps oscillating In 
their behaviour, and reluctant to formulate conclusions without reassurance 

Conceptual Vevel (Hunt, 1971) Is another cognitive style construct 
which has a conceptual similarity to aspects of ref 1 ec 1 1 on- i mpu 1 s I v I ty . 
Hunt describes conceptual level as the degree to which one possesses 
fully developed internal structures or representations of one's self and 
others. Persons with a low conceptual level are described as egocentric, 
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as Impulsive and as having a low tolerance for frustration and ambiguity. 
They therefore require a learning environment characterized by high 
structure and low uncertainty. Persons with a high conceptual level are 
characcerlzed as Independent and reflective. They cope easily with 
choosing among alternatives and therefore do well In learning environments 
without Imposed structure. Hunt (1970 reports that delinquency among 
a sample of low CL boys was significantly higher than among a high CL 
g roup . 

A central aspect of each of the cognitive styles described above 
Is the attending behaviour of the student. In eye movement studies 
conducted on subjects while reading or solving a visual problem, Impulsive 
adults and children make fewer eye fixations than the more accurate 
responders (Drake, 1 970 r C ra I ghead , 1978). Impulsive search and scan- , 
ning strategies are typically unsystematic, random and global. Other 
attentional characteristics of the Impulsive person Include those assoc- 
iated with hyperactivity - off task behaviour. Irrelevant talk and move- 
ment and lack of self-control (Douglas, 1972; Campbell, 1973; Margolls 
et al., 1977; Kendall and Wilcox, 1979.) 

Tjierefore, If a student fails to scan the environment for appro- 
priate Information In an ambiguous situation, errors in thinking are likely 
and the student may be perceived as being impulsive; In the absence of 
internal cues, the student musfrely on external direction which contrib- 
utes to field-dependency; and the perceived low structure In the environ- 
ment would frustrate the student having a low conceptual level. The 
student whose styles interfere with the "quality" of time on task will 
likely exhibit poor school performance when school conditions permit. 

Each of the four cognitive styles are typically measured by their 
associated paper-and-pencil psychometric Instruments. Because they 
tap such a narrow band of behaviour and are therefore highly Inferen- 
tial when used to predict a wider band of more complex behaviour, observa- 
tional measures were developed for each in order to determine their 
ecological validity. These observational measures were designed to form ^ 
an inferential hierarchy for each of the styles, thereby completing the 
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multitrait-multlmethod matrix. Three lower Inference measures were 
developed for each of the four styles: teacher rating scales, global 
measures by naive judges and a check list of specific, discrete 
behaviours used by observers. H tems for these measures were derived 
from the literature, with the exception of an adapted version of the 
Self Control Rating Scale (Kendall and Wilcox, 1979) used by teachers. 
Kendall and Wilcox report a correlation of .25 between the Scale and 
MFFT errors. Judges used a single, global scale measure for each style. 
The .observers noted the frequency of occurance of specific behaviours 
within '♦O second intervals. Judges and observers made their observa- 
tions by viewing a kO minute videotape of each of the subjects engaged 
In classroom discussion and problem solving activities, and by listening 
to an audio recording of an Interview between the subject and investi- 
gator regarding the student's views about his or her classroom activity. 
(See Campbell and Davis, 1981 for complete description of measures.) 
A summary of the variables Is presented' in Table 1. 

Table 1 about here 



Re-s u 1 1 s 

Results in terms of correlations must be viewed as tenuous in view 
of the small number of subjects involved. However, the unusually high 
rank-order correlations obtained and the patterns which emerge from 
the multitrait-multimethod matrix suggest justification for reasonable 
confidence. 

Table 2 about here 

The four methods crossed with four styles create a 16 x 16 multl- 
trait-multjmethod matrix, shown 'in Table 2. The matrix is interpreted 
by compari'^ng the validity diagonals with the coefficients in the triangles 
In an effort to facilitate interpretation of the matrix, an alternative 
method of presentation was devised which quickly and graphically, conveys 
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a representation of construct validity.- Similar to a nomol og i ca 1 net- 
work, a correlational map was created. Correlations which achieved 
significances are represented by lines connecting the variables. Hori- 
zontal connections are indicative of a lack of discriminant validity. 
Vertical connections are indicative of convergent, or in the work pres- 
ented here, of ecological validity. 

Figure 1 about here 

A number of observations are evident from analysis of the correla- 
tional map: 

1. Four of the possible six correlations among measures of impuls- 
ivity were significant with the absolute mean at .62 (p <.0l). 
Reflection-impulsivity emerges as the only cognitive style construct 
having relatively good ecological validity. 

2. There is marginal evidence for conceptual level being ecologic- 
ally valid. Judges and teachers both agree with the observer. 
However, none of these naturalistic observational" methods are 
associated with the usual psychometric measure of the construct'. 
This suggests that the paragraph completion test neither taps 
the behaviour extrapolated from the literature nor what teachers 
and others actually observe. 

3. No evidence for ecological validity is found for field dependence- 
independence or for attentional focus. 

k. A marginal case for discriminant validity can only be made at 
the level of teachers' ratings. 

5. Ref lection-impulsi /ity, as measured by the Matching Familiar 

Figures Test, shares substantial variance with each of the other 
three psychomet r i c measures (absoluts mean correlation of .6^ (p <.0l)) 
and therefore- lacks discriminant validity at this high level of infer- 
ence.' However, the pattern of correlations invites another interpre- 
tation. Because the three measures are independent of one another, 
yet are all associated with ref l«ct i on- i mpu 1 s i vi ty , there is support 
for the suggestion that reflection-impulsivity can be viewed as a 



8. 

more holistic pattern of behaviour than previously described. 
Impulslvltv Is shown to correlate significantly with fleld- 
. dependence, low conceptual level and low attentional focus 
with measures at both high and low Inference. 

Some impl I cat Ions 

A ciumber of implications emerge from the study.' First (assuming' 
replication with a larger number of subjects confirms the present 
findings), the ref 1 ect Ion- 1 mpu 1 s i v 1 1)^ sty 1 e construct emerges as an 
ecologically valid and parsimonious descriptor of a component of 
student behaviour. With good description and agreement on Its character- 
istics, attention can be turned to compensating for or remediating 
impulsive characteristics which hinder learning performance. The Issue 
is of particular concern among teachers of students in which Impulsive 
behaviour Is a prevalent characteristic. 

Second, In terms of procedure, the use of a hierarchy of low to 
high inference measures of ^ocess" traits Is advocated as a means of 
assessing t he I r ,eco 1 og I ca 1 validity In typical classroom learning 
activities. In the particular case of ATI and other correlational 
designs, for example, effects or their absence may be erroneous conclu- 
sions If the ecological validity of high Inference aptitude measures is 
either unknown or in doubt. 

- And a final word regarding discriminant validity. Anyone familiar 
with the literature on the Identification and description of cognitive 
processing variables, of which cognitive styles Is a subset, must at 
least occasionally become frustrated with the plethora of variables 
generated by psychologists who may be more worried about tenure, legacies 
or epitaphs than the parsimony of their discipline. When encountering 
this over-abundance of Invented constructs, an Intuitive reaction Is 
that many are addressing essentially the same phenomenon or processes 
which are different only In the label applied. Little wonder that 
teachers have d I smI s sed • t he utility of much of this research. The 
work reported here gives credibility to the notion that a synthesis 
of constructs Is both reasonable and possible. 
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Table 1 



Multitrait-Multimethod Matrix: Summary of Criterion Measures 



Methods of Assessment 



Cognitive Styles (Traits) 

Ref lect ion-Impulsivity 
(RIMP) 

Field Dependence -Independence 
(FDD 

Conceptual Level 

(CD 

Attentional Focus 
(AF) 



Psychometric 
(P) 



PRIMP 
PBCO^^ 



PFDI 



PCL 



PAF 



Judge 

(J) 



Observer 
(0) 



JRIMP 



JFDI 



JCL 



JAF 



ORIMP 



OCL 



OAF 



Teacher 
(T) 



TRIMP 



TFDI 



TCL 



TAF 



Table 2 



MultUvaUj^lultlrnethod Matijx 



PRIMP PFDI PCL PAF 




JRIMP JFDI JCL JAF 



TFDI 
TCL 
TAF 



OFDI 

OCL 

OAF 
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* » **** I 
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-.58 
* 



.04 
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.01 -.52 ^.30^^.15^ 
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Notes. Each heterotrait-monomethod .triangle 
TTi^^closed by -a solid line E^^^^^^^'J"" 
trait-heteromethod triangle is enclosed by 
a broken line. Correlations Spearman 
Rank-Correlaticn Coefficients. Degrees of 
freedom vary from 9 to 11 due to certain 
missing data values in the Teacher s Rat- 
ings. 
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Figure 1 
' Correlational Map Showing 



Convergent and Discriminant Validity 
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